Nonequilibrium Phase Transitions in Directed Small- World Networks 



O 

o 

(N 

> 

o 

O 

cn 
(N 



Alejandro D. SanchezQ, Juan M. Lopez! and Miguel A. Rodrfguezi 

Instituto de Fisica de Cantabria, CSIC-UC, E-39005 Santander, Spain 

Many social, biological, and economic systems can be approached by complex networks of inter- 
acting units. The behaviour of several models on small-world networks has recently been studied. 
These models are expected to capture the essential features of the complex processes taking place 
on real networks like disease spreading, formation of public opinion, distribution of wealth, etc. In 
many of these systems relations are directed, in the sense that links only act in one direction (out- 
wards or inwards). We investigate the effect of directed links on the behaviour of a simple spin-like 
model evolving on a small-world network. We show that directed networks may lead to a highly 
nontrivial phase diagram including first and second-order phase transitions out of equilibrium. 
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Complex networks have recently attracted an increas- 
ing interest among physicists. The main reason being 
that they seem to be exceedingly simple model systems of 
complex behaviour in real world networks J3,01 , including 
chemical reaction networks , food webs , the Inter- 
net @,| and the World- Wide- Web @, metaboHc @ and 
protein networks scientific collaboration networks 

I p^ , etc. The hope is that the ideas and techniques devel- 
oped in the last fifty years in the field of statistical physics 
to deal with cooperative phenomena in many body sys- 
tems, may be useful to understand emergent complex 
behaviour in systems outside the traditional realm of 
physics. In particular, small-world (SW) networks, re- 
cently introduced by Watts and Strogatz jl^] , have been 
very much studied because they constitute an interesting 
attempt to translate the complex topology of social, eco- 
nomic and physical networks into a simple model. SW 
networks result from randomly replacing a fraction p of 
links of a d-dimensional regular lattice with new random 
links. As a result of this random rewiring, SW networks 
interpolate between the two limiting cases of a regular 
lattice {p = 0) and completely random graphs [p — 1). 
Studies of real network data have shown that SW-like 
topologies are found in situations as diverse as the net- 
work of movie actors collaboration, the electric power 
grid of Southern California, the network of world air- 
ports, the acquaintance network of Mormons, etc 0J^. 

Many topological properties of the SW model have re- 
cently been investigated, as for instance the shortest-path 
distance and clustering coefficient 14|, the crossover 
from regular to SW behaviour occurring at p — Q [p^ , 
a mean-field solution and percolation on SW net- 
works (l^] among others. Specifically, SW models are 
expected to play an important role in understanding the 
interplay between the underlying disordered network and 
the dynamics of many social or economic processes, such 
as distribution of wealth, disease spreading, transmission 
of cultural traits, and formation of public opinion |^]. 

In the language of social network analysis sites 
are referred to as actors. Actors may represent individ- 



uals, companies, airports, countries, etc., depending on 
the social or economic process we are interested in. Ac- 
tors are linked to one another by a relational, social or 
physical tie like for instance, friendship, business trans- 
actions, flight connections, kinship, or scientific collab- 
oration, among many others. Some of those relational 
links are symmetric, in the sense that if Alice is tied to 
Bob, then Bob must also be tied to Alice, as occurs for 
instance in the authorship of scientific papers. However, 
many other networks are directed and exhibit links that 
are definitely asymmetric, like for instance in the case 
of networks of import-export of goods, world-wide-web 
pages links, lending transactions, food webs, cultural in- 
fluences, etc. In directed networks then, when Alice is 
tied to Bob, Bob may not be linked to Alice but to some- 
one else instead. Asymmetric synaptic strengths have 
already been shown to be very important in trying to de- 
scribe the process of learning in realistic neural network 
model approaches to brain function |p^ , po| . 

Several models have recently been studied in order to 
understand the effect of SW topology on classical systems 
like the Ising model or the spread of infections and 
epidemics pl] , p^ . Such a simple models are expected to 
capture the essential features of the more complicated 
processes taking place on real networks. However, as 
mentioned earlier, many social, commercial or biological 
relations are asymmetric and the following question nat- 
urally arises: What is the effect of directed links on a 
simple model that evolves on the network? 

In this Letter we investigate the effect of directed SW 
topology on the behaviour of a simple model. In case only 
undirected links are used, our model becomes identical to 
the classical Ising model on a standard (undirected) SW 
network [Q. This allows us to study, in a systematic 
way, the effect of directed ties on this classical model. 
We find that the existence of directed links completely 
changes the behaviour of the system from mean-field be- 
haviour (for undirected networks) to a highly nontrivial 
and rich phase diagram in the case of directed networks. 
By means of extensive numerical simulations we find 
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that, for rewiring probabilities in the range < p < pc, 
the model exhibits a line of continuous phase transitions 
from an ordered to a disordered state. Those phase tran- 
sitions occur at a critical value of the temperature Tc{p), 
which depends on p. However, for higher disorder densi- 
ties Pc < P < 1, the phase transition becomes first-order. 
Our results show that, in order to model biological, social 
or economic processes on complex networks, it is crucial 
to take into account the character, directed or undirected, 
of the corresponding relational links. 

The model.- We have studied directed networks in 
d = 1 and 2. For simplicity we focus here on d = 2 and 
further results in c? = 1 will be published elsewhere. In 
order to construct a directed SW network, we start from 
a 2-dimensional square lattice consisting of sites linked 
to their four nearest-neighbours by both, outgoing and 
incoming links. Then, with probability p we reconnect 
nearest-neighbour outgoing links to a different site cho- 
sen at random. After repeating this process for every 
outgoing link we are left with a network with a density p 
of SW directed links, as shown in Figure 1. Note that, by 
this procedure, every site will have exactly four outgoing 
links and a varying (random) number of incoming links. 
Generalization to higher dimensions is straightforward. 

Adopting social network nomenclature, actors are then 
placed at the network sites. Any given actor is connected 
by four outgoing links to other actors, which we call 
mates. We allow every actor to be in one of two possible 
states, so that, at any given time, the state of an actor 
is described by a binary spin-like variable Si G {+1,-1}. 
Depending on the state of their mates, an actor may 
change its state according to a majority (ferromagnetic) 
rule: Actors prefer to be in the same state as their mates 
are. In order to implement this, we introduce the pay-off 
function 

G(z) = 2s, (1) 

mates of i 

where the sum is carried out over the four mates of ac- 
tor i. Note that this pay-off function is positive when- 
ever Si points in the same direction as the majority of 
its four mates. External noise is included to allow some 
degree of randomness in the time evolution by means 
of a temperature-like parameter, T , which we shall call 
temperature for short from now on. For a given value 
of the external temperature, the update of the model is 
then performed as follows: At each time step, an actor 
(network site) is randomly chosen and its correspond- 
ing pay-off function G{i) is computed according to Eq. 
(|l|). If G{i) < 0, actor i is opposing its mates' major- 
ity and the change Si —Si is accepted. Unfavorable 
changes, i.e. when G{i) > 0, are accepted with probabil- 
ity exp[— G(i)/r], which depends on temperature in the 
usual fashion. 

Concerning the physics of the above defined model, 
there are two interesting points that should be explicitly 



mentioned. On the one hand, the model is nonequilib- 
rium since detailed balance is not satisfied. On the other 
hand, the model is not simply the asymmetric counter- 
part of the Ising model, since the pay-off function G{i) 
in Eq. (|l|) does not include the corresponding interaction 
terms coming from the ingoing links (needed in order to 
identify G{i) with the energy change after a spin update 
in the asymmetric Ising model). In fact, one can easily 
see that the pay-off function G(i) of our model cannot 
be written as variation of any Hamiltonian. However, 
we would like to remark that if only symmetric links are 
allowed, our model becomes exactly equal to the (equilib- 
rium) Ising model in an undirected SW network that was 
studied in Ref. This can be seen by a simple com- 
parison of the pay-off function Eq. (|l|) with the change 
of energy after a spin update in the standard (symmet- 
ric) Ising ferromagnet. In this case, it is known that the 
system presents mean- field behaviour for any value of the 
disorder p > @. 

Results.- We have carried out extensive numerical sim- 
ulations of the model for different values of the density 
of SW directed ties p and temperature. Our results are 
qualitatively the same for directed networks generated 
from regular lattices in d = 1 and 2. In the following we 
focus on d = 2. We have simulated the model in directed 
SW networks generated from L x L square lattices for 
sizes ranging from L = 8 to 100 and different rewiring 
probabilities p G [0, 1]. The system is left to evolve until, 
after some transient, a stationary nonequilibrium state 
is reached. The stationary state can be described by the 
appropriate order parameter, which can be defined in a 
natural way by means of the 'magnetization' per site 
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m=— ^s^. (2) 

i=l 

We find that the system becomes ordered, i.e. {\m\) ^ 0, 
below a critical temperature Tc{p), so that most actors 
are, in average, in the same state. In Figure 2 the av- 
erage absolute value of the order parameter is plotted 
vs. temperature for two different values of the disor- 
der p = 0.1 and 0.9, calculated in systems of different 
sizes. For every system size L^, results were averaged 
over both, 10 runs of the dynamics for each network re- 
alization and n different realizations of the network, in 
such a way that nxL^wl.SxlO^. Figure 2 shows that 
the order-disorder transition is continuous (top panel) for 
a low disorder density, while it becomes discontinuous 
for a higher concentration of directed SW links (bottom 
panel). A more systematic study of the phase diagram, 
as shown in Figure 3, reveals that there is a line of contin- 
uous phase transitions for disorder densities below some 
critical value pc- Very interestingly, the transition be- 
comes first-order above pc, indicating that there exists a 
nonequilibrium tricritical point at Pc- We estimate Pc to 
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be roughly at Pc = 0.65(5). The character, continuous or 
discontinuous, of the phase transition is better reahzed 
when looking at the probability density function (PDF) 
of the order parameter. For sake of illustration, the insets 
of Fig. 3 show typical PDFs at points of the phase dia- 
gram (p,T), all near the critical line. From those PDFs, 
one can see that the phase transition is second-order from 
Fig. 3a to 3b, in the region p < Pc- In contrast, ior p > pc 
the transition is discontinuous, from Fig. 3c to 3d. The 
most probable values of m, which correspond to the two 
equally highest symmetric peaks in Fig. 3c, become un- 
stable in favor of m = as the transition line is crossed 
towards Fig. 3d. The transition occurs in such a way 
that the order parameter exhibits a finite jump at the 
critical line. 

The critical behaviour of the model in the region 
p < Pc, where transitions are continuous, can be stud- 
ied in detail. We find that the order parameter exhibits 
finite-size scaling with exponents that depend on the dis- 
order density p. Close to the critical point, \t\ — > 0, we 
have (|m|) - |t|^, where t ^ [T - Tc)/Tc. is the reduced 
temperature. At the critical point, i = 0, the order pa- 
rameter scales with system size as (|to|) ~ L-l^/'', where 
V is the correlation length exponent. Figure 4 displays 
the behaviour of (|?ti|) vs. L for two disorder densities 
p = 0.1 and 0.5 below p^ « 0.65. Only for T = Tc{p) a 
power-law is obtained and the slope of the straight line 
in a log-log plot gives an estimation of the ratio (3/v be- 
tween critical exponents. From Fig. 4 we obtain that 
for p = 0.1 and p = 0.5, P/v = 0.53(2) and 0.40(3), 
respectively. Moreover, from data collapse analysis (not 
shown) at the corresponding Tc{p) we have (i = 0.50(3), 
u = 0.94(6), and (3 = 0.30(3), v = 0.80(3) for p = 0.1 
and p = 0.5, respectively. These critical exponents are 
different from both mean-field, (/? = ;/= 1/2) and exact 
values (/3 = 1/8 and v — V) iox the Ising model vn d — 2. 

Conclusions.- Many social, economic and biological 
networks in the real world exhibit directed ties or rela- 
tions. This may be modeled by including directed links in 
the corresponding complex network model. In addition, 
spin-like models, borrowed from statistical physics, have 
recently been proposed as toy models to understand some 
social processes, like for instance conflict vs. cooperation 
among coalitions [p3|j24[ or formation of cultural domains 
p5| . We claim that the directedness of the network may 
strongly affect the behaviour of simple processes evolving 
on complex networks. We studied the effect of a directed 
small-world topology on a very simple spin model. Our 
model becomes equal to the Ising model when all links 
are undirected. From numerical simulations we showed 
that, when directed links exist, the phase diagram of the 
model is nontrivial. We found that the system exhibits 
continuous phase transitions for disorder densities below 
a critical threshold Pc ~ 0.65. For stronger disorder, the 
transition is first-order. At this stage we can only specu- 
late that the competition among weekly coupled clusters 



may be related to the existence of first-order transitions. 

We believe that the effect of directed links may be rele- 
vant in other types of disordered networks, like free-scale 
networks, and different dynamical models. In trying to 
model real systems, directed links may play an important 
and unforeseen role. 
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FIG. 1. Sketch of a directed small-world network con- 
structed from a square regular lattice in d = 2. For sake 
of clarity only a few links have been reconnected. Arrows in- 
dicate the direction of the corresponding link. Dotted lines 
represent rewired links. Note that every site always has four 
outgoing links. 




FIG. 2. Order parameter vs. T for different system sizes. 
For p = 0.1 (top panel) the transition is continuous. For 
a higher disorder density, p = 0.9, the transition becomes 
first-order (bottom panel). 




FIG. 3. Phase diagram of the model. The system is in the 
ordered state below the line. Points are numerical determina- 
tions of the critical temperatures Tc{p) for different degrees 
of disorder. The transition is continuous for small values of 
p (circles), while it becomes discontinuous for p larger than 
Pc ~ 0.65 (filled circles). The insets show the PDFs of m 
for: a) p = 0.1, T = 2.68; b) p = 0.1, T = 2.70; c) p = 0.9, 
T = 2.498; d) p = 0.9, T = 2.500. Simulations were per- 
formed in a 100 x 100 sites network. 
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FIG. 4. Finite-size scaling of the order parameter for 
p = 0.1 (hollow symbols) and p — 0.5 (filled symbols), both 
below Pc- Power-law behaviour is obtained for T — 2.700(2) 
and T = 2.635(3) for p = 0.1 (squares) and p = 0.5 (filled 
squares), respectively. 
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